Recently, the Internet Watch Foundation (IWF) issued a warning that the appearance of AI-generated Child Sexual Abuse Material (CSAM) has become increasingly frequent on the open web, reaching a 'critical point'. The safety oversight body stated that in the past six months, the quantity of illegal content created by AI they have discovered has already surpassed the total from the previous year. Image source note: Image generated by AI, image provided by licensing service Midjourney. IWF's interim CEO Derek Ray Hill.

A report from Anglia Ruskin University reveals a rapid increase in demand for AI-generated child sexual abuse images on the dark web. Researchers Dr. Deanna Davy and Professor Sam Lundrigan analyzed chat logs from dark web forums over the past 12 months and found that online criminals' interest in using AI technology to create child pornography materials is rising. They are self-learning and sharing experiences to create AI-generated abusive images online. The study points out that the problem posed by AI technology is that law enforcement agencies face significant challenges in understanding and responding to AI-generated materials.

Students are using artificial intelligence to create images suspected of child sexual abuse, with a shocking level of realism. Experts are calling for urgent action, suggesting schools stop the dissemination of child sexual abuse materials. The quality of the images is comparable to professional children's photographs, and the realistic portrayal of children could be spread across the internet. Child protection organizations recommend the establishment of better systems to prevent such harmful behavior.

The Internet Watch Foundation (IWF) warns that the issue of child sexual abuse images may worsen. The report calls for the government and technology providers to swiftly control the artificial intelligence that generates deepfake images. Generative AI systems could lead to virtual child deepfakes, expanding the potential victim pool. Strengthening legal responses to AI-generated abuse, particularly with recommendations aimed at the EU.